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ABSTRACT 


The U.S. Army uses a combat simulator, Janus(A), to simulate high-tech ground 
battle exercises. The algorithms used to represent battlefield behavior and to generate 
battle scenarios must be calibrated by well-trained, combat-experienced technicians. The 
calibration is time-consuming and subject to human errors. A Single Exercise Analysis 
System (SEAS) is under development for automating and improving the battle scenario 
generation process for Janus(A). A neural network based model has been proposed to 
support the route determination process within SEAS. The purpose of this thesis is to (1) 
determine the best neural network architecture for determining tank routes and (2) develop 


a prototype for generating these routes. 
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I. INTRODUCTION 


A. PURPOSE 

A neural network based route generation process is 
proposed to improve the performance of scenario generation for 
the Army’s Janus(A) combat model. More specifically, when the 
quality of data permits, this process will automate processes 
currently performed manually. Eventually, a finished version 
of this prototype will be integrated with a Single Exercise 
Analysis System (SEAS) under development. 

There are two primary purposes for this thesis. First, to 
determine the best neural network architecture for determining 
tank routes. Second, to develop a prototype for generating 


these routes. 


B. BACKGROUND 

The U.S. Army utilizes Janus(A), a combat simulator, to 
emulate the complex reality of high-tech ground battles or 
battle exercises. This model is equipped with algorithms that 
represent battlefield behavior in typical combat situations. 
This combat simulator provides calibration mechanisms for 
adjusting simulation parameters to allow for various battle 
contexts that might occur. This calibration must be performed 
by an analyst who is well-trained and experienced in combat. 


imac eteon, Me mist be familiar with the combat simulator. 


This calibration 1S time-consuming, subject to human errors 
and may not be complete (Tversky and Kahneman, 1974). 

A neural network algorithm is proposed to perform the task 
of generating tank routes for training and evaluation and 
training. This 1s proposed to seek a behavioral rather than 
analytical representation of the tanks ina battlefield. It is 
also an effort toward using machine learning techniques for 
analyzing actual combat behaviors. This neural network will 
capture actual successful routes of tank commanders who were 
confronted with evolving combat simulations. This algorithm 
will then be used to predict the movement of a tank given its 


intial, peewee. 


C. ORGANIZATION OF THE THESIS 

The thesis iS organized as follows. Chapter II provides 
an overview of the route determination process and of using 
neural networks for route determination. Chapter III 
describes the search for the best network architecture for 
route generation and the results of the search. Chapter a 
presents the prototype for route determination. The summary 
of findings and recommendations for further research 1S 


provided in Chapter V. 


II. OVERVIEW OF USING NEURAL NETWORKS FOR ROUTE DETERMINATION 


A. TANK ROUTE DETERMINATION PROBLEM 
According to the U.S. Army doctrine (USA-FM17-15, 1987), 
a tank commander should determine his route based on the 


Eeebowing major principles: 


¢ Follow the route determined by the concept of operation. 


* Employ unit movement techniques and drills to balance 
speed with likelihood of enemy contact. 


¢ Use the terrain and natural or man-made cover and 
concealment to mask his weapon system from enemy 
observation. 

It 1s expected that trained troops will follow as close as 
possible the concepts of engagement laid out by high-level 
command. However, factors on the battlefield may require 
Slgnificant departures from company commander’s intent and 
execution plan. Factors governing a tank commander’s movement 
include his position, route, enemy’s position, and his 
vulnerability. 

Route determination is a dynamic, real-time reasoning 
process with incomplete and possibly inexact information. As 
a battle unfolds, each time slice can be perceived by the tank 
commander as a life-threatening crisis that forces him to 


reevaluate his next movement. (Bul et al., 1992) 


B. OVERVIEW OF ROUTE DETERMINATION TECHNIQUES 

As a decision problem, there are at least three approaches 
or techniques that can be used to determine routes. These are 
a mathematical model approach, a heuristic approach and a data 
inductive approach. 

A mathematical model approach would attempt to consider 
all relevant factors that lead to the determination of a 
route. Once these factors are determined and required data 
gathered, models would be developed for determining routes. 

A heuristic approach would try to harness the knowledge of 
experts. In our case, an expert platoon commander’s knowledge 
would form the basis of an automated expert system that could 
be used to determine routes. This requires gathering an 
expert’s expertise in some way and then modeling and coding 
this knowledge. The resulting expert system could 
theoretically be used to determine tank routes. Such expert 
systems have been applied in the field of medical science, for 
example. These systems support medical personnel decision 
making. 

The data inductive approach conjectures that, in some 
complex situations such as the route determination process eae 
would be impossible to model all direct causal relationships 
due to incomplete, uncertain and dynamic information. Te 
circumvent the difficulty in applying analytical reasoning 
uSing quantitative algorithms, the inductive approach 


hypothesizes that there is a lot to learn from those tanks 


that successfully make it though to their planned destination. 
Neural networks are the form of inductive approach we have 


chosen as the subject of this thesis. 


C. USING NEURAL NETWORKS FOR ROUTE DETERMINATION 
1. A Brief Description of Neural Networks 

A neural network 1s a system consisting of several 
Simple, highly interconnected homogeneous processing units 
called neurons (Figure 1). Fach neuron 1S ae simple 
computation device that continuously reacts to external 
inputs. Typically, a neuron receives input signals from other 
neurons, aggregates these signals based on an input function, 
and generates an output signal based on an output function or 
transfer function. A weighted directed graph represents the 
interconnection of the neurons. Nodes represent neurons and 
links represent connections. The weight assigned to the link 
between two neurons represents the relative importance of that 
ark 

The crucial problem in training neural networks is 
determining a set of weights assigned to the connections that 
best maps all input units to their corresponding output units. 
In other words, the learning process can be seen as a non- 
linear optimization problem that minimizes output differences. 
The back-error propagation technique is probably the most 
widely used algorithm for minimizing the output differences. 


(sur et al,, 1992) 





INPUT NEURONS HIDDEN OUTPUT NEURONS 
NEURONS 


LEGEND: Wy , Wik : Connection Weights 


Figure 1. Neural Network Architecture 
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The back-error propagation technique iteratively 
assigns weights to connections, computes the errors between 
outputs and target outputs, propagates this error information 
baek, layer by layer, from the output units to the input 
units, and adjusts the weights until errors are minimized. 
The back-error propagation technique does not guarantee an 
optimal solution. However, various experiments reported by 
Rumelhart et al. (1986) and by other researchers (Maren et 
al., 1990; Freeman, 1991) suggest that the algorithm provides 
solutions that are close to the optimal ones. 

2. Advantages of using Neural Networks for Route 

Determination 

As stated previously, the idea of using neural 
networks for route determination is based on the hypothesis 
that there 1s a lot to learn from those tanks’ that 
successfully made it through to their planned destination. A 
neural network trained to actual routes should be able to 
produce routes that simulate the dynamic movements of actual 
tank routes. These routes are derived without any detailed 
knowledge of how the actual routes used for training had been 
chosen. 

3. An Example 

After a battle exercise is conducted at the National 

Training Center, Ft. Irwin, those tanks that reached their 


destination are considered successful. For this exercise, 


their mission was to reach a destination located approximately 
9 kilometers North-East of their initial position. As these 
tanks moved toward their goal they would make contact with the 
opposing force. Nineteen tanks were successful and their 
routes were used to train the network model. 

Forty-two coordinates, taken at five-minute intervals, 
represent the route of each tank. Each route begins with a 
point of departure and the destination point. The coordinates 
are x and y coordinates on the training area grid. 

After training the network model, it can be used for 
generating routes from any feasible start coordinate. For 
example, an x coordinate of 43900 and a y coordinate of 96225 
may be used as input to the model. The model will generate a 
coordinate, such as 44250, 98475, that it predicts 1s the next 
coordinate in the route. This coordinate will be used as 
input and another coordinate will be generated. Eventually, 


an entire route will be generated in this manner. 


D. ISSUES RELATED TO USING NEURAL NETWORKS 
1. Architecture 
A neural network architecture refers to how the 
neurons are connected to each other and what kind of neurons 
they are. Typical neural networks are designed in layers of 
neurons. Each layer is a group of neurons that share a 
functional feature. The network used for route determination 


has three layers. The first layer, the input layer, has the 


mae OmetakIng 1m Ene route data, in our case this is a tank 
position. The second layer, the hidden neuron layer, uses the 
@Wepue from the first layer to calculate its output to the 
third layer. The third layer, or output layer, has the task 
Seo coducing an output; the next tank position. Figure 2 
Mmblictrates how a neural network architecture for determining 
tank routes might appear graphically. 

Part of the task of designing the network architecture 
1s determining the number of neurons included in each layer. 
The data available for successful tank routes include: the 
tank designation (unit number), time of position (every 5 
Minutes), the x and y coordinates of the tank and the next x 
and y coordinates of the tank (see Appendix A for a complete 
Pemmcout of the data). From this data it 1S necessary to 
decide which data is significant for the network. Table 1 


presents an example of the data available for this research. 


TABLE 1. EXAMPLE OF RESEARCH DATA 


ine eonit NO . pec OOrd:. emeoOord . Next Next 
°C Secale”. Ye eoord. 


}60 [42 ‘| 43900 96225 44250 98475 
Re ee rT s8500 


Since we desire to produce a route that is a series of 







positions, the network needs the x and y coordinate data. The 
network does not need to know tank designations so that data 


1s not used as an input. 








X COORDINATE, X COORDINATE, , « 


Y COORDINATE, Y COORDINATE, , « 


INPUT NEURONS HIDDEN OUTPUT NEURONS 
INITIAL TANK POSITION NEURONS NEXT TANK POSITION 


Figure 2. Neural Network Architecture for Tank Routes 
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When a network trains, it looks at the x and y 
coordinates and predicts the next x and y coordinates. Since 
the next x and y coordinates are 5 minutes into the future, 
modi tact can be considered implicit. Because time 1s 
mem ete 1 the Goordinate data, it is not necessary to 
iielude tame explicitly as am input to the network. This 
narrows the inputs to the neural network to the x and y 
coordinates. The input layer will have two neurons, one 
representing the x coordinate and one representing the y 
coordinate. 

We want the network to predict the next x and y 
coordinates when given a current x and y coordinate. 
Therefore, the output layer will consist of two neurons 
representing these coordinates. 

It 1S not as simple to determine the number of neurons 
in the second, hidden, layer. Because hidden neurons are 
necessary for the network to perform its calculations, having 
too few neurons in the hidden layer will cause the network not 
to train at all. Because increasing the neurons adds to the 
complexity, too many neurons may mean slower training and 
running (California Scientific Software, 1990). California 
Scientific Software, the maker of our neural network tool, 
BrainMaker, suggests using the average of the input and output 
neurons as the number of hidden neurons. If this number is 
less than 25, they suggest some undetermined number more than 


the average. They suggest that complex problems such as 


pol. 


problems with hundreds of facts may require more hidden 
neurons while straightforward or linear problems tend to 
require fewer. Our problem is both straight forward (given a 
coordinate produce the next coordinate) and has hundreds of 
facts (42 coordinates in an average route and a set of 19 
routes). Determining the optimum number of neurons 1S a major 
portion of the research for this thesis. 

We added network training percentage to what is 
commonly considered the architecture of the neural network. 
Training percentage refers to the number of predictions a 
network must get correct to complete training. When training, 
the x and y coordinates are the inputs and the next x and y 
coordinates are the output patterns with which the network 
will compare its predictions. The network considers its 
prediction correct when it falls within the training tolerance 
of .100 (10 percent). For example, a network will consider 
its prediction correct if it predicts 45000 - 95000 (x aici 
coordinates) and the output patterns are 49400 - 95500. We 
quickly discovered that it is not possible to train yeu 
networks to 100 percent. 

In a set of training data (also called training facts) 
there may be some data that exhibit unuSual patterns. For 
example, consider that an entire platoon is progressing over 
the terrain but one tank has a problem and stops for 20 
minutes. That only one tank is not progressing for some 


period will not make sense to Eneunecteven When the tank 


I 


recovers and proceeds to catch up at a rapid pace, the network 
may not understand that behavior. The network may be unable 
Mon predict the next x and y coordinates for the tank during 
these periods since its behavior does not correlate with that 
of other tanks. Since such situations may not make sense to 
the training program it may not be possible to train this 
Motwork £O 100 percent. In fact, it is not possible to train 
our network to 100 percent given the route data used during 
Our research. We needed to determine what network training 
percentage would allow the network to train and not degrade 
the network’s prediction accuracy. 
2. Accuracy 

Initially, accuracy simply seems to mean "How close 
are predicted x and y coordinates to the actual x and y 
coordinates?". However, we found that any of the networks 
that train, despite the number of neurons, very accurately 
predicted next x and y coordinates when presented with an 
actual x and y coordinate. This makes sense because, to 
successfully train, a network must predict the next x and y 
coordinate to within a 10 percent tolerance of the output 
pattern. Therefore, we expanded accuracy to mean "How close 
to the generic, or average tank route, is a predicted tank 
route?" In other words, we give a network start coordinate 
and the network produces the next coordinate. We then give 


BiemeteceWwen~ this Coordinate and it produces the next 
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coordinate, and so on until the network will no longer produce 
a different coordinate. We then compare this series of 
coordinates (which comprise a route) to the generic (average) 
tank route to determine how closely the predicted route 
follows the average route. 

Initially, our basis for judging the routes consisted 
of whether the route generally Poniere the path of the 
average route. Eventually, the number of coordinates in the 
route (representing the average speed of advance) became an 
additional er lMeemilom, 

3. Ability to Handle Unexpected Start Positions 

Also included in the testing was how the network 
handled unexpected start positions. These include such as 
those located in terrain that is not traversable by tanks. 
Would the network try to recover by proceeding to possible 
positions or would it just be unable to predict a route? 
Impossible start positions are primarily a theoretical problem 
Since the intended eventual uses of the proposed route 
prediction system will have no reason to propose an impossible 
start position. Yet, a somewhat unexpected start position may 
be possible and the ability of the network to handle this is 


important. 
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III. SEARCHING FOR AN APPROPRIATE NETWORK ARCHITECTURE 


A. METHODOLOGY 
1. Changing the Number of Hidden Neurons 

As stated previously, the makers of BrainMaker 
recommend the average of the input and output neurons as the 
number of hidden neurons unless this number is less than 25. 
The average 1S two and, although significantly less than 
twenty-five, we used two hidden neurons as the start. From 
meee we Gecided to try 4, 6, 8, 10, 12, 15, 20, 25, 30, 35, 
Pereeo>, 20, 60, 70, 80, 90 and 100 or until it was obvious 
that increasing the number of hidden neurons was not going to 
increase the accuracy of the network. These choices were 
arbitrary, but incrementally representative, since we felt 
that increasing hidden neurons by 1 until 100 would be 
prohibitively time consuming and unnecessary. If 1t appeared 
that using 20 hidden neurons produced better routes than those 
produced with 15 and 25 hidden neurons then we would try 
varying hidden neurons around 20 to determine the optimum 
number. Eventually, we did train some networks using 


Seeaterent mumbers of hidden neurons not on our initial list. 


if) 


2. Testing the Accuracy of Trained Networks 

Initially, we put the network predicted coordinates 
and the output patterns into a spreadsheet and determined the 
average of the differences between them. We had hoped that 
the best network would have the smallest average differences. 
Although there were ranges from an average of 4 yards 
difference to 244 yards difference, these are not significant 
when talking about numbers such as 33,000 to 120,000. Also, 
the larger differences did not suggest any sort of trend. In 
other words, we found that using 20 hidden neurons produced 
average differences of 4 yards and using 70 hidden neurons 
produced average differences of 244 yards suggesting that 
networks with fewer hidden neurons produce more accurate 
predictions. On the other hand, we found that using 60 hidden 
produced differences of 13 yards and using 15 hidden produced 
differences of 121 yards which suggests that networks using 
more hidden neurons produce better predictions. Obviously, 
this method of evaluation is ineffective and probably 
meaningless (as discussed earlier). 

We determined that evaluating the network performance 
visually (by comparing graphs of predicted routes with graphs 
of actual average routes) was the best method. Since we want 
routes that are feasible and generally reflect the behavior of 
successful routes, this method provides us with the means to 


evaluate these characteristics. 
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We used a generic tank route (Figure 3) for 
comparison. This route consists of coordinates that are the 
average of the position of the tanks in the training data at 
each particular time. For example, the first coordinate is an 
average of each tank’s position at time 0 and represents the 
average start coordinate. The terrain (Figure 4) of the 
training area 1s such that some areas are inaccessible for the 
tanks. We used this graph to determine if generated routes 
avoided these areas as well. 

We generated routes from each trained network from the 
generic route’s average start coordinate (34135 - 97327) and 
visually compared them to the generic route. We visually 
compared the generic and generated routes to find how much 
they resembled each other. We also verified that the 
generated routes avoided the inaccessible terrain. 

3. Training Time 

We expected the training time to increase as we 
increased the number hidden neurons. We felt that the time it 
takes to train a network would become an important factor as 
we increased the number of hidden neurons. We felt there 
might be a point where increasing the hidden neurons (and, 
theoretically, the training time) might not increase the 
Erecuracy or the network enough to justify the increase in 
Bramnineg time. Therefore, we considered training time while 


evaluating networks. 
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4. Unexpected Start Positions 

Once we narrowed the networks down to the best three, 
we further evaluated them with unexpected start positions. We 
felt that it be the final factor in determining the "best" 
network architecture for predicting tank routes. 

We chose three test positions. The first, 40000 - 
105000, 1s within the vicinity of the destination, but south 
of any of the original routes. The second two, 42000 -110000 
and 57000 - 102000, are located within hilly terrain 
considered impassable. We chose these points to evaluate 
whether the network might "recognize" this terrain as 
impassable and try to take a quick route to familiar 
territory, proceed directly to the destination area, or be 
unable to produce a route. 

5. Summary of Training and Evaluation Procedure 

It was evident that it would be prohibitively time 
consuming to try to train every network while varying the 
tralning percentages from 100 percent to 90 percent (for 
example). The first step was to find a test percentage that 
would allow the network to train and to train in a reasonable 
period without noticeably depreciating the performance. In 
view of the possible eventual use of a route prediction 
system, we considered 5 hours to be the maximum amount of time 
to be reasonable and hoped to get training times to within an 


hour. To do this, we decided to use a test network with 10 


20 


hidden neurons and to train and evaluate it (not in detail) 
when trained at varying training percentages. 

As expected, at 100 percent the network would not 
train at all. Again at 99 and 98 percent, the network would 
Meestrain within 5 hours. At 97 and 96 percent, training time 
dropped to between 1 and 2 hours. At 95 percent, training 
took 22 minutes and 50 seconds and training time took much 
less as we lowered the training percentage. There were almost 
no differences in the routes produced by the networks trained 
to 97, 96 and 95 percents. Networks trained to percentages 
less than 95 percent produced routes which differed 
noticeably. 

It seems safe to assume that networks trained to a 
higher percentage should be more accurate. We also believe 
that a time of less than 30 minutes would be very acceptable 
for our purposes (in fact, training time will drop on faster 
hardware). Since there was a perceptible difference between 
those networks trained to less than 95 percent and those 
trained to 95 percent and above, we decided to train our 
networks to 95 percent for this research. 

Once we established our training percentage, we 
proceeded to train networks with the various numbers of hidden 
neurons described previously. After completion of training, 
we evaluated the attributes of training time, accuracy and 


handling of unexpected start points as described in the 


Zt 


previous sections. Figure 5 graphically illustrates the 


evaluation process. 


B. RESULTS 
1. Changing the Number of Hidden Neurons 

Networks were trained with the following numbers of 
hidden neurons: 2, 4, 6, 8, 10, 12, 15, 20, 25, 320) 253 
AS SO pee 6 Ose 0 pO ee meee eee After evaluating each 
network, we trained networks using 7, 9, and 11 hidden neurons 
to fine tune the analysis. 

2. Testing the Accuracy of Trained Networks 

We eliminated several networks after visually 
comparing the routes they produced. Some networks could not 
produce a complete route even when started with the average 
start coordinate. For example, the networks using 2 and 15 
hidden neurons both failed after generating 6 to 10 
coordinates of a route (Figures 6 and 7). Some networks 
produced routes that behaved like the successful tanks only in 
a very broad way, meaning that they generally started south- 
west like the generic route and eventually ended near the 
generic route’s end coordinate. The route generated by the 
network with 20 hidden neurons (Figure 8) 1S an example. Some 
networks (like the network with 25 hidden neurons) produced 
routes that appeared to behave quite differently from the 
generic route although generally ending near the generic end 


coordinate (Figure 9). 
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Figure 6. Route Generated by Network with 2 Hidden Neurons 
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Figure 8. 


Route Generated by Network with 20 Hidden Neurons 
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Figure 9. 


Route Generated by Network with 25 Hidden Neurons 
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As stated previously, visual comparison eliminated 
most of the networks from further consideration. Those 
trained with 8, 10 and 12 hidden neurons merited further 
consideration. 

a. Testing with an Architecture of 8 Hidden Neurons 

This network produces a route that 1s very good 
visually (Figure 10). Im othenmewords, it closely folio vaaen. 
generic tank route’s path and ends very near to the average 
end coordinate. This route follows the path of the generic 
route more closely than the others. 

Closer inspection shows that it contains 30 
coordinates compared to the original tank route’s 42. This 
Suggests a much more rapid speed of advance than the original 
tanks. A tank travelling as predicted by this network would 
reach its destination 60 minutes earlier than the original 
tanks. This suggests that, although producing a visually 
acceptable route, this route does not closely follow the 
Original tanks’ average speed of advance (the generated tank 
route 1S 29 percent faster). 

The performance of this network prompted us to try 
a network with 7 hidden neurons as well. This network (Figure 
11) produces a route that is almost identical with that of the 
network with 8 hidden neurons. It also has 30 positions which 


suggests the faster speed of advance. 
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Figure 10. Route Generated by Network with 8 Hidden Neurons 
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b. Testing with an Architecture of 10 Hidden Neurons 
This network also produces a route that 1s very 
meoa visually (Figure 12). It contains 38 coordinates 
compared to the original 42 suggesting that this tank would 
reach the final destination just 20 minutes earlier than the 
Original tanks. Although this is not an exact replication of 
the actual tanks’ speed of advance, it was the nearest of all 
the networks. It 1s just 9.7 percent faster than the average. 
Since this network generated a very acceptable 
route, we trained networks with both 9 and 11 hidden neurons 
to find if either of those produced better routes. The route 
generated by the network with 9 hidden neurons (Figure 13) is 
also very good visually, however it contains only 31 
coordinates suggesting a much more rapid speed of advance. 
The route generated by the network with 11 hidden neurons 
(Figure 14) is only fair visually and has just 21 coordinates. 
We determined that to be unacceptable. 
c. Testing with an Architecture of 12 Hidden Neurons 
This network also appeared to be acceptable 
moiteially (Figure 15). However, the speed of advance 1s 
extremely fast. This route contains just 24 coordinates 
indicating an average speed of advance 43.9 percent more rapid 


than the actual tank routes. 
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Figure 12. Route Generated by Network with 10 Hidden Neurons 
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Figure 13. 


Route Generated by Network with 9 Hidden Neurons 
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Route Generated by Network with 11 Hidden Neurons 
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Figure 15. Route Generated by Network with 12 Hidden Neurons 


35 


After comparison with the other networks) | tim. 
network was clearly not the best. We did not train a network 
with 13 hidden neurons. 

d. Discussion 

All the networks we trained with various numbers 
of hidden neurons produce routes except the two mentioned 
previously (those with 2 and 15 hidden neurons). Yet, most 
were obviously not good predictors or replicators of the 
actual routes. For example, those trained with 20 and 25 
hidden neurons produced routes that were not very good 
replications and had an extremely slow average speed of 
advance (refer to Figures 8 and 9). After comparing all the 
routes, we narrowed the possibilities to those discussed in 
the previous three sections. 

Initially, we had only planned to compare the 
routes visually, but we noticed that one of the major 
differences between routes was the number of coordinates. It 
became a major evaluation factor since it seems obvious that 
a tank’s average speed is an important behavior. The route 
produced by the network with 8 hidden neurons followed the 
generic route’s path most closely. Yet, the route produced by 
the network with 10 hidden neurons also followed the path of 
the generic route closely and was the closest in average speed 
of advance. The network with 12 hidden neurons was clearly 


the 1nferier ob ele geermcer 
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3. Training Time 

Although the BrainMaker documentation indicated that 
using more hidden neurons will tend to cause the network to 
train slower, we found that this was not necessarily the case. 
As we increased the number of hidden neurons from 2 to 10, the 
training time also increased. However, training time dropped 
Significantly at 15 hidden neurons. The erainingw™ time for 
this network was 2 minutes and 48 seconds, but, as explained 
in the previous section, this network was unable to generate 
a route. This fact suggests that increasing the hidden 
neurons will not always increase the training time. Table 2 


presents the training time for some selected networks. 


TABLE 2. NETWORK TRAINING TIMES 


[sigden Neurons 2 __[e [ue] [as Jamo 





Table 2 is a representative sample of the observed 
training times. Training times did not increase as hidden 
neurons increased. For example, the network with 100 hidden 
neurons trained in just 4 minutes and 56 seconds. These times 
Suggest that the number of hidden neurons may not be the 
meter 1m training time we expected at all. Of course, the 
number of hidden neurons may be a significant factor in 


training time for other problems. 


Sy) 


We determined that training time was not a significant 
evaluation factor. Although the training time for the network 
with 10 hidden neurons was longer than those of the other 
networks, it 1s not sufficiently longer to eliminate it from 
consideration as the best network. 

4. Unexpected Start Positions 

We used the three start positions discussed previously 
(40000 - 105000, 42000 - 110000 and 57000 = 102000) Riia. 
generate routes with all three of the final networks. 
Although the network with 12 hidden neurons is clearly not the 
best of the three, we felt that it would be interesting to 
include it in this evaluation process for comparison. 

We expected the best network to produce routes that 
clearly led out of the impassable terrain to safe terrain when 
presented with the first two start positions. We also 
expected the networks to recognize the third start position in 
the vicinity of the destination area and to produce a route 
that leads to the path of the generic route and on to the 
CGO dias 

a. Testing with and Architecture of 8 Hidden Neurons 

Figure 16 shows the routes generated by the 
network with 8 hidden neurons. Both of the routes originating 
from the first two start positions lead generally to the safe 
terrain and on to the goal. The rovte origunaeing Ercan 


third start position quickly moves toward the generic route 
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Routes Generated by Network with 8 Hidden Neurons 


ay 


and on to the goal. We noticed that the rate of advance is 
very fast from the first two start posltiems and Ehe Heme. 
traverse across the hilly terrain instead of leading more 
directly to the safe terrain. 
b. Testing with an Architecture of 10 Hidden Neurons 
These routes (Figure 17) are very interesting. 
The routes originating at the first two start positions lead 
very directly to the safe terrain. These routes then appear 
to follow the path of the route produced from the average 
Start position on to the goal. This network appears to 
strongly "recognize" the hilly terrain and to try to take a 
direct route to safe terrain. The route originating from the 
third start position behaved as expected and behaved very 
Similarly to the route generated by the network with 8 hidden 
neurons. The speed of advance for all three routes closely 
follow that of the route this network produced from the 
average start position. 
c. Testing with an Architecture of 12 Hidden Neurons 
As expected the routes produced by this network 
(Figure 18) were the poorest. This network clearly 
"recognizes" the goal and produced routes from all three start 
positions that lead very directly to that goal. It clearly 
does not recognize the hilly terrain and completely ignores it 
while travelling to the goal. The speed of advance of these 


routes 1S extremely fast. 
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Figure 17. Routes Generated by Network with 10 Hidden Neurons 
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Figure 18. Routes Generated by Network with 12 Hidden Neurons 
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d. Discussion 
The network with 10 hidden neurons appears to 
perform best when presented with unexpected start positions. 
The network with 8 hidden neurons also performs well. 
However, we believe this route to be inferior because of its 
rapid speed of advance and because its routes travel through 
the hilly terrain rather than leading more directly to safe 


merrain. 


Cc. SUMMARY OF FINDINGS 

The networks with 8 and 10 hidden neurons were clearly 
Superior to the network with 12 hidden neurons. Of the 
former, the network with 8 hidden neurons most closely follows 
the generic route. However, the network with 10 hidden 
neurons also follows the generic route very well and most 
closely replicates the average speed of advance. This network 
also handles the unexpected start positions best. We believe 
that the difference in training times 1S insignificant. These 
facts lead us to the conclusion that the network with 10 
hidden neurons is the best for route determination. 

Given the training data for this research, the network 
architecture required for producing the most accurate routes 
Howelear. The network will consist of 3 layers with the input 
and output layers both consisting of 2 neurons and the hidden 
layer consisting of 10 hidden neurons. The network 1s to be 


trained to 95 percent. 
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IV. A PROTOTYPE FOR ROUTE DETERMINATION 


A. REQUIREMENTS 

As part of the SEAS development, data used for training a 
network will be presented in a DOS text file for use by this 
prototype. The data will only contain the information that is 
relevant; x and y coordinates and the next x and y coordinates 
for each tank’s successful route. The data is changed to 
represent the coordinates in thousands. For example 55678 
wi ldb bewSs46737 This is because the BrainMaker program is 
more efficient when dealing with these numbers than with the 
full numbers. Following is an example of two lines of data 


Tromethas Eake: 


TABLE 3. EXAMPLE NETWORK TRAINING DATA 


S/S ECO. es Slee 63 LOTS) 
Dp ciGs sO a0 nS. Sen © Lio) 2s lees, 


Other requirements are an MS-DOS computer, the BrainMaker 






program (not provided) and the prototype files. 


B. PROTOTYPE ARCHITECTURE 
We used a combination of the BrainMaker software, batch 
files and a program written in Ada to create a prototype of a 


system that can be used to generate tank routes. Figure 19 
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Figure 19. Logical Diagram of Prototype 
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diagrams the prototype’s route generation process. The 
operating instructions for the prototype are included in 
Appendix B. The prototype files are available from Professor 
Bul on request. 

We developed the prototype on an MS-DOS” 386SxX-iGtia 
Personal Computer. The training and route generation times 


will vary with the computer hardware. 


C. A SAMPLE RUN OF THE PROTOTYPE 

Once the data from an actual exercise 18S gathered and 
formatted ina DOS text file, the user can begin the process 
of training a network and generating routes. The user must 
have the BrainMaker and Netmaker program files, the exercise 
data file and the prototype batch and program files in the 
same directory on a MS-DOS computer. 

The first step in this process is to create a BrainMaker 
Definition file which will be used to train a network. To do 
this the user will start the program Netmaker by typing 
"NETMAKER filename" where filename is the name of the 
exercise data file. Once the program starts, the user will 
see the exercise data that will form the basis of the 
BrainMaker Definition file. The user will classify the first 
two columns as "basis" columns and the next two columns as 
"result" columns (the first two columns represent the 
"present" x and y coordinates while the next two columns 


represent the x and y coordinate after 5 minutes). The next 
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step 1S to save the definition file as "brainrts.def." The 
user will then choose the "Go to BrainMaker" option from the 
menu displayed. 

Once BrainMaker 1S running, the user will set the training 
percentage to 95 percent and select "train network" from the 
menu. After the network is trained, the user will save the 
network as "brainrts.net." The user now has a network trained 
and ready for use. 

To generate routes, the user will start the network 
generation program by typing "route" at the user prompt. The 
user will be prompted for the start coordinate from which the 
program will generate a route that will be contained in a DOS 


moxtertile called "“route.fil." 
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V. CONCLUSION 


A. SUMMARY OF FINDINGS 

The purpose of this thesis was to (1) search for the best 
neural network architecture for generating tank routes, and 
(2) develop a prototype for route generation. Our findings 
suggested a 3 layer network with 10 hidden neurons that seems 
to produce the best reproduction of actual routes. The input 
and output layers will both consist of 2 neurons and the 
hidden layer will consist of 10 neurons. The network is to be 
trained to 95 percent. Also, in Chapter IV, we described the 


architecture of the prototype. 


B. RECOMMENDATIONS FOR FURTHER RESEARCH 
The findings of this thesis suggest the following 
recommendations for further research: 
¢« More automation and improvements of the prototype so that 


it is more user friendly. The prototype presented in this 
work should be refined to completely automate network 


training and route generation. The user should be 
required to do little more than input start positions for 
routes. 


¢ Testing with more tank battle scenario data. In additmen 
to different battle scenarios, we suggest using various 
numbers of routes for training and then evaluating the 
program’s effectiveness. We conducted some preliminary 
tests using as few as 4 routes for training and generated 
some reasonable route replications. 
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Integration with other modules of the SEAS. For example, 
another module in the SEAS should produce the data file 
needed by the route determination module for training a 
network. The routes generated by the route determination 
module will be used by other modules of the system. The 
entire SEAS will automate many processes currently 
performed by human operators. 
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APPENDIX B 

PROTOTYPE OPERATING INSTRUCTIONS 
reo LREMENTS : 
- BrainMaker Professional software sold by California 
Scientific Software (not provided with thesis) 
- Prototype Diskette (included with thesis) 
- MS-DOS based computer with hard drive 
SerrinG STARTED: 


1. Install BrainMaker software on computer hard drive. 


2. Copy all prototype diskette files into the BrainMaker 
Beerectory and change to this directory. 


TRAINING A NETWORK 

1. Create a BrainMaker Definition file by typing "NETMAKER 
filename" at the DOS prompt. Filename is the name of the file 
containing the route data. We included the data used in this 
thesis (modified as described in Chapter IV, Section A) ina 
file called data.txt. For example, type "NETMAKER DATA.TXT" 
to create a definition file from this data. 

Within the NetMaker program: 


2. Set test file percentage to zero (0). 


3. Within the NetMaker program, label the columns, in order, 
peer, NEXTX AND NEXTY. 


4. Classify the first two columns as "basis" and the second 
two columns as "result." 


5. Save your definition file as "brainrts.def" and choose the 
"Go to BrainMaker" option from the menu. 


Within the BrainMaker program: 

6. Set training percentage to ninety-five (95). 

7. Select the "Train Network" option from the menu. 

8. After the program trains the network, save the network as 


otratares mee” and exit brainmaker. 


oa) 


GENERATING ROUTES: 


1. Start the route generating program by typing “route ee 
the BOs promos. 


2. Type in the x coordinate of desired start position when 
prompted. For example, 55.790 if you desire 55790. 


3. Type in the y coordinate of desired start position when 
prompted. For example, 99.45 for 99450. 


4. The program will display the start position (for example 
55.79 and 99.45) and ask you to verify them. Type "y" and 
press enter if they are correct and "n" and enter if you wish 
to change them. 


5. When you verify the information 1S correct, the program 
will inform you that it 1s about to generate a route and that 
you must stop the program by pressing Ctrl-Break when the 
displayed coordinates start to repeat. 


6. The generated route is saved ina file named route.fil. 
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